Image processing device and information recording medium

ABSTRACT

An image processing device for realizing more realistic pictures of explosions in video game devices as well as other devices. Objects displaying such pictures of explosions are formed of spherical polygons (R 1 , R 2 , R 3 , . . . ) and planar polygons (S 1 , S 2 , S 3 , . . . ). Pictures of explosions are realized by alternately arranging these spherical polygons and planar polygons with the lapse in time. Preferably, pictures of polygons are realized by arranging the spherical polygons in layers on the boundary of the planar polygons.

This is a continuation of application Ser. No. 10/681,172, filed Oct. 9,2003, now U.S. Pat. No. 6,980,207 which is a divisional application ofSer. No. 09/369,302 filed Aug. 6, 1999, now U.S. Pat. No. 6,664,965, allof which are incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to image processing technology in videogame devices.

2. Description of the Related Art

Pursuant to the progress in computer graphics (CG) technology, a virtualworld can now be represented even more realistically. A video gamedevice utilizes such CG technology.

As an example of a video game, there is a shooting game. This type ofgame device is generally equipped with a gun unit, CPU for graphicsprocessing, monitor, and so on. When a player aims the gunpoint at atarget (enemy character) appearing on the monitor screen and pulls thetrigger on a gun unit, the game device detects the position on themonitor screen of the light signal emitted from the gun unit, andperforms image processing such as processing for destroying the enemycharacter based on such position data.

As one example of a typical gun shooting game heretofore, there is“Virtua Cop (Trademark)” manufactured by Sega Enterprises, Ltd. In thisgun game, players compete for scores by using a gun unit and shootingdown enemy characters appearing in the virtual three-dimensional space(game space) on the monitor screen. Here, an enemy character appears ata predetermined location on the monitor screen in a predeterminedtiming. When the player directs the gunpoint of the gun unit toward theenemy character, the viewpoint on the monitor screen approaches theenemy and such enemy character is enlarged and displayed on the monitorscreen. Actions of the enemy character are controlled by an imageprocessing program loaded in a game device and, when required, the enemycharacter attacks the player viewing the monitor screen.

However, the inventors have discovered through intense study that thefollowing problems must be resolved in order to increase the reality ofthe game and represent the picture more realistically.

First, processing of explosion pictures in a conventional shooting gameuses, for example, planar polygons and spherical polygons in order todecrease the amount of polygon data for representing explosion pictures.A texture of explosion pictures is affixed to these polygons and theanimation of explosions is realized by rotating etc., this texture.Processing of explosion pictures using planar polygons is disclosed inInternational Publication No. WO95/35555. According to this method,polygons such as explosion patterns are always facing the direction ofthe line of sight and inconveniences upon using planar polygons(necessity to make the plane always face the direction of the line ofsight) are resolved as it comprises camera control matrix processingmeans, object matrix processing means, and object pattern displayprocessing means.

However, when representing explosion pictures with planar polygons, theboundary between the explosion picture and background becomes unnatural,resulting in the picture lacking reality. In other words, there is aninconvenience that the boundary between the explosion picture andbackground is a straight line. Moreover, when representing explosionpictures with spherical polygons, the explosion picture becomesmonotonous, resulting in the picture lacking reality. Thus, a morerealistic explosion picture is desired.

Second, upon realizing explosion pictures by combining a plurality ofpolygons, conventionally, explosion patterns concerning all suchcombinations were registered in a prescribed storage field. Reference ismade to FIG. 6(A) and FIG. 7 for the explanation thereof. FIG. 6(A)shows four combinations of explosion data A1, B1, B2, C1, and C2(patterns (1) through (4)) structuring the explosion object. FIG. 7shows the explosion pictures represented by the combination of suchexplosion data. Pattern (1) corresponds to FIG. 7(A), pattern (2) toFIG. 7(B), pattern (3) to FIG. 7(C), and pattern (4) to FIG. 7(D),respectively. Conventionally, explosion data was registered in advancefor each of these four patterns, and one pattern was displayed by beingselected optionally from the registered explosion patterns uponprocessing explosion pictures.

However, registering the explosion data in advance for all explosionpatterns led to a problem in that the necessary memory increasespursuant to the increase in the variations of explosion patterns.

Third, there is a problem in that the movement of characters isunnatural because the motion interpolation processing in between the twodifferent motions was insufficient heretofore. Motion interpolationprocessing is, for example, image processing to smoothly connect twomotion changes (changes in motion patterns), such as from an “attackingmotion” to a “collapsing motion,” when an enemy character in anattacking mode is shot. Conventional motion interpolation processing isexplained with reference to FIG. 8(A). When the enemy character is in anattacking motion, the enemy character attacks with a predeterminedmotion pattern (motion pattern M). If the enemy character is damaged bythe attack made by the player character, the enemy character makes atransition from an “attacking motion” to a “collapsing motion.” Aplurality of patterns are predetermined for this “collapsing motion” andone of those patterns is selected in accordance with the situation ofthe enemy character being damaged or the game environment at such time,etc. Further, the “collapsing motion” is structured of a plurality ofmotion patterns (hit pattern H1, hit pattern H2, . . . ). Motioninterpolation processing C is performed during the several frames whenthe transition from motion pattern M to hit pattern H1 is being made.Thus, the unnaturalness of the sudden transition from motion pattern Mto hit pattern H1 can be solved as it will be in slow motion during suchtransition.

Nonetheless, as this method only performs motion interpolationprocessing C during the transition period from motion pattern M to hitpattern H1, changes in the motion are only slowed down temporarily andunnaturalness still existed when viewed as a whole.

Fourth, in conventional shooting games, enemy characters shot by bulletsretreat straight back regardless of where the bullet hit or thedestructive power of the bullet. Thus, when shooting with the likes of amachinegun which successively fires bullets, the shooting becomes easyas there is no change in the two-dimensional position of the enemycharacter, resulting in the amusement being lowered. This point isexplained with reference to FIG. 9. As shown in FIG. 9(A), the enemycharacter retreats from position E1 to position E2 regardless of theposition at which the enemy character is shot. The direction of retreatis parallel to the player's line of sight. Therefore, the game screenseen from the player's side, as shown in FIG. 9(B), only shows thechanges of the enemy character moving from position E1 to E2. As thereis no change in the two-dimensional position of the enemy character whenseen from the player's side, the shooting is easy and the amusement islowered.

Fifth, when the enemy character is attacked and it is to counterattackafter the collapsing motion (shot-down motion), an opportunity isprovided to the player for shooting if the enemy character starts theattacking motion from the very beginning, resulting in a problem thatthe amusement of the game is lowered. This point is explained withreference to FIG. 11(A). Suppose that the enemy character is attackingin the attacking motion pursuant to predetermined attacking steps M₁, M₂. . . M_(n-1), M_(n). Here, for example, M₁ is an attacking step ofholding the gun at a ready, M₂ is an attacking step of aiming the gun,M₃ is an attacking step of firing the bullet from the gun, and soon.Further suppose that the enemy character, during attacking step M₃, isdamaged upon being attacked by the player character. The enemy characterwill make a transition to the “shot-down motion” and, after thecompletion of such “shot-down motion,” will return to the first step ofthe attacking motion, that is, attacking step M₁. Thereafter, as theenemy character will perform in order attacking steps M₁, M₂ . . .M_(n-1), M_(n), it can not readily counterattack the player character.In other words, this provides the player character an opportunity toattack while the enemy character is performing attacking steps M₁, M₂,resulting in a problem that the amusement of the game is lowered.Although it is possible to disregard the “shot-down motion” upon theenemy character being attacked, this will also result in the amusementof the game being lowered as the player will not be able to enjoy thefeeling of the bullet hitting the target.

Sixth, there is a problem in relation to the flight locus of a bulletseen from the line of sight of the player character. As shown in FIG.12(A), conventional shooting games displayed the flight locus of abullet seen from a moving player character as a flight locus of a bullethaving the resulting speed vector upon subtracting the playercharacter's speed vector from the bullet's speed vector. Therefore, whenthe moving direction of the bullet and the moving direction of theplayer character were the exact opposite, the speed of the outwardappearance of the bullet is increased and the player is unable to reactto such speed.

Seventh, there is a problem in the acceleration of the collisionjudgment. Here, collision judgment is the judgment of whether twoobjects collided and an example thereof is the collision judgment of abullet and a building. This collision judgment is simplified by modelingthe bullet as a line segment and the building as a plane and obtainingthe intersection thereof. As conventional collision judgments judged thecollision of the bullet (line segment polygon) with every building(planar polygon), high-speed game processing was hindered due to theexcessive time required for the calculation. Moreover, as shown in FIG.13, when a car operated by the player moves along a road preformed on agame space, the area in which the car may move is restricted to theroad. Thus, the virtual area for collision judgment, area 1, area 2, andsoon are formed along the road. And, as shown in FIG. 14(A), buildings(building 1, building 2, and so on) existing within each respective areaare stored in advance in correspondence therewith. Collision judgmentbetween the bullet fired from the player character driving the car andthe aforementioned buildings is performed by, as shown in FIG. 14(B),checking each area to determine in which area the bullet exists (stepB1). This area check is conducted by comparing the coordinates of thebullet modeled as a line segment polygon and the coordinates of eacharea. After confirming the area in which the bullet exists, collisionjudgment is performed with respect to each of the buildings existing insuch area (step B2). According to this method, collision judgmentbetween the line segment polygon representing the bullet and the planarpolygon representing the building can be accelerated as only a planarpolygon within a prescribed area need only be judged. However, as theaforementioned area only exists in a limited area of the game space,there is an inconvenience in that collision judgment can not beperformed in a region not including such area. There is also anotherproblem with this method in that game programs are complicated aspolygons for areas need to be provided according to game scenes.

Eighth, in shooting games, there is a problem with representing wavemotions consequent of explosions of the bullet and the like. Astechniques of representing waves, for example, pattern change andtexture scroll are known. Pattern change is a technique of displayingwaves by modeling every, condition of the wave motion and switching eachmodel to the same position. With this technique, there is a problem inthat the amount of data is increased as models for every condition of awave must be prepared in advance. Texture scroll is a technique ofpreparing textures representing waves and displaying waves on thepolygons by scrolling such textures. However, it is not possible torepresent a three-dimensional wave as only planar pictures moveaccording to this technique. Thus, a technique of representing realisticthree-dimensional waves with a small amount of data is desired.

Ninth, when a game story is made from a plurality of stages and theorder of such stages is predetermined in a game program, there is aproblem in that the progress of the game is monotonous. Therefore, it isconsidered that the amusement in the game will increase if it ispossible to change the progress of the game according to the player'sintention.

Tenth, in conventional game devices, for example, there is a typewherein prescribed vibration is delivered to the player upon theexplosion of enemy characters. In such conventional devices, thevibration generating device was driven by a sound signal generatedpursuant to the sound data of background music and the like. This led tothe vibration generating device picking up the aforementioned soundsignals even during scenes having no relation to the explosion of enemycharacters, resulting in unnatural vibrations.

SUMMARY OF THE INVENTION

The present invention was devised in view of the aforementioned problemsof the conventional art. An object thereof is to provide an imageprocessing device and information recording medium preferable for gunshooting games and the like, superior in reality and naturalness incomparison to the games heretofore, and capable of considerablyenhancing the game feeling as well as the interest in the game. Anotherobject of the present invention is to reduce the burden of the operationprocessing during image processing. A further object is to provide avibration generating device for generating appropriate vibrations inaccordance with game scenes.

An image processing device of the present invention for displaying apicture of an object changing forms within a predetermined time framecomprises a storage means for storing spherical polygon data and planarpolygon data forming the object, and image generating means for readingsuch spherical polygon data and planar polygon data from the storagemeans and generating images of the object by combining sphericalpolygons and planar polygons.

Preferably, the image generating means sets the direction of the formchange of the object and, by alternately arranging the spherical polygondata and planar polygon data along this direction as well as coveringthe boundary of planar polygons with spherical polygons, obtains imagesof the object.

By covering the boundary of planar polygons with spherical polygons asmentioned above, it becomes difficult to distinguish that the polygonsare planar, thereby realizing realistic and natural images. Further, byrepresenting images by arranging spherical polygons at the boundary ofplanar polygons, it is possible to avoid the unnaturalness of theboundary of the planar polygons, thereby realizing realistic formchanges of an object. The aforementioned object, for example, iseffective if it is an object representing an explosion.

An image processing device of the present invention for displaying apicture of an object changing forms within a predetermined time framecomprises a storage means for storing hierarchically, with respect toeach possible form adoptable by an object, the relation between theplurality of structural elements structuring the object, and an imagegenerating means for generating images of the object by selectinghierarchically one optional form among the plurality of forms adoptableby such object and reading from the storage means for each hierarchy thestructural element corresponding to such form. According to thisstructure, it is possible to keep the data of an object to a minimum,thereby enabling the efficient usage of memory. The aforementionedobject, for example, is effective if it is an object representing anexplosion.

An image processing device of the present invention for representing aseries of motions of an object comprises a storage means for storing inadvance the motion patterns of the object, and an image generating meansfor generating images of such object by alternately repeating, upon themotion pattern of the object changing, the step of performing motioninterpolation processing of an object and displaying the result on thescreen and the step of reading the motion pattern after the change fromthe storage means and displaying the result on the screen, and graduallydecreasing the number of times the motion interpolation processing isperformed.

According to this structure, it is possible to produce a smooth changein the motion of an object, thereby preventing an unnatural feeling ofstoppage. In other words, the motion of the object is naturalized by notonly performing motion interpolation processing at the time the motionof the object changes, but also thereafter. By gradually decreasing thenumber of times the motion interpolation processing is performed, theeffectiveness thereof can be furthered more advantageously. The changein motion patterns of an object is, for example, preferable if it is achange from an “attacking motion” to a “collapsing motion upon beingshot.”

An image processing device of the present invention for displaying on ascreen, upon a first object flying within a virtual three-dimensionalspace colliding with a second object arranged in the virtualthree-dimensional space, a picture showing a change in the position ofthe second object comprises a storage means for storing coordinatevalues of the second object, an operation means for operating the momentsuch second object is subject to upon colliding with the first objectand computing the coordinate values of the second object aftercollision, and an image generating means for renewing the coordinatevalues of the second object stored in the storage means pursuant to suchcalculation and generating images of the second object after collision.

Preferably, the image generating means calculates the coordinate valuesof the second object after collision so as to change the two-dimensionalposition of the second object seen from a virtual viewpoint. Forexample, the first object is a bullet and the second object is an enemycharacter. According to this structure, when the enemy character isattacked, the two-dimensional position of the attacked enemy characterwill shift when seen from the player's line of sight, thereby increasingthe difficulty of shooting the enemy character and enhancing theamusement of the game. As the player will be required to improve his/hershooting techniques, an advanced shooting game is provided thereby.

An image processing device of the present invention for displaying aseries of motions of an object comprises a first storage means forstoring priorly divided motion patterns of the object as a plurality ofmotion steps, an image generating means for reading the motion patternsfrom the storage device and displaying the same on a screen, a detectingmeans for detecting changes in the motion patterns of the object, afirst image controlling means for storing identification information ofthe motion step in the second storing means upon the detecting meansdetecting a motion change in the object and controlling the imagegenerating means such that it reads other motion patterns from the firststorage means and displays the same on the screen, and a second imagecontrolling means for making the image generating means perform, uponcompletion of displaying images of the other motion patterns, a motionpattern of a transition of a motion step of said object pursuant to theidentification information stored in the second storage means.

For example, the aforementioned object is an “enemy character,” theprescribed motion pattern is an “attacking motion,” and the other motionpattern is a “collapsing motion upon being shot.” According to thisstructure, the attacked enemy character will return not from the initialmotion, but from the condition it was shot, and therefore does notprovide an opportunity to the player for shooting. Thus, a player isrequired to improve his/her skills resulting in the difficulty in theshooting game increasing, thereby enhancing the amusement of the game.

An image processing device of the present invention for displaying on ascreen an image of a first object moving within a virtual space seenfrom a virtual viewpoint of a second object operated by a playercomprises a storage means for storing in advance motion patterns of thefirst object, a means for calculating the distance between the firstobject and second object and computing a synthetic vector by adding tothe speed vector of the first object the vector calculated bymultiplying the coefficient corresponding to the distance to the inversevector of the speed vector of the second object, and an image generatingmeans for reading transition patterns from the storage means andgenerating images of the speed vector of the first object as thesynthetic vector.

Preferably, the aforementioned coefficient is a coefficient having aninverse proportion to the distance. Further, the first object is abullet. Accordingly, as it is a structure wherein the speed of the firstobject seen from the second object is either added or subtracted incorrespondence to the distance between the first object and the secondobject, it is possible to represent naturally the flight locus of thebullet in a game since the speed vector of the second object isuninfluenced when the bullet (first object) is in a position far fromthe second object, and the movement of the bullet is effectivelycontrolled when the bullet is at a distance near the second object.

An image processing device of the present invention for judging thecollision between a first object moving within a virtual space and asecond object arranged within the virtual space comprises a storagemeans for storing, upon the virtual pace being partitioned per unit gridpursuant to three-dimensional coordinates, the second object existingwithin the unit grid in correspondence with each unit grid, and acollision judgment means for performing a step of judging the unit gridin which the first object exists and a step of judging the collisionbetween the second object in the unit grid in which the first objectexists and the first object.

Preferably, the collision judgment means models the first object as linesegment polygons, models the second object as planar polygons, andthereby performs collision judgment according to the intersection ofsuch line segment and plane. Further, the collision judgment means setsa virtual three-dimensional space around the perimeter of the secondobject and performs the collision judgment by dividing thethree-dimensional space into unit grids. The first object is a “bullet.”According to this structure, upon the collision judgment between thebullet and other objects, an effective collision judgment can be madewithout having to perform collision judgment with respect to all otherobjects existing within the virtual space. That is, acceleratedimplementation of collision judgment is possible as collision judgmentneed only be performed regarding the object existing in the unit grid inwhich the bullet exists. Regarding the unit grid in which the bulletexists, the length of the line segment polygons representing the bulletneed only be divided by the length of each of the three axis directionsof the unit grid. Thus, the calculation is simple, and the burden of thecalculation processing is minimized. Moreover, the length of each of theaxis directions of the unit grids may be suitably set in relation to thenumber and size, etc. of polygons and within the virtual space.

An image processing device of the present invention for displaying on ascreen an object representing the movement of the surface of a flowingbody comprises a storage means for storing in advance changing patternsrepresenting changes in the surface of the flowing body, and an imagegenerating means for forming the object as an aggregate of polygonsalong a prescribed direction of the flowing body and generating imagesof the object by reading the changing patterns from the storage meansand changing the length of the polygons along the prescribed direction.Preferably, the movement of the flowing body is a “wave movement.”According to this structure, it is possible to represent realisticmovements of a wave in comparison to the conventional art. This isespecially advantageous in representing images of three-dimensionalwaves.

An image processing device of the present invention for executing gameshaving a plurality of stages, wherein the first stage and final stageare predetermined, and the intermediate stages may be suitably selectedin correspondence with the player's game progress. According to thisstructure, as the player is able to suitably select the intermediatestages, the amusement in the game is enhanced.

Here, “ . . . means” in this specification is a concept realized duringimage processing, and does not necessarily correspond one-on-one to aparticular hardware or software. Identical hardware elements may realizea plurality of “ . . . means” or a plurality of hardware elements mayrealize a single “ . . . means.” In other words, these “ . . . means”are realized by programs stored in memory or other information recordingmedium within a computer. The information recording medium according tothe present invention stores a program capable of making a computerfunction as the image processing device of the present invention.

A vibration generating device according to the present inventioncomprises a storage unit for storing vibration waveform data registeredupon being associated in advance to each object, and a controlling unitfor reading vibration waveform data associated with the object when aprescribed event occurs to the object and generating vibrations byoutputting such data to the vibration generating device. Particularly,it is preferable that the vibration generating device is a low frequencysound vibration device. According to the present invention, thevibration generation circuit pursuant to explosions and the like ofobjects is a separate circuit from the sound signals such as forbackground music, thereby realizing suitable sound effects incorrespondence to the scenes.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an overall perspective view of the game device;

FIG. 2 is a diagram of a flying machine and a player character ridingsuch flying machine;

FIG. 3 is a block diagram of the game device;

FIG. 4 is a flowchart of the processing steps of an explosion picture;

FIG. 5 is a diagram explaining the structure of the explosion object;

FIG. 6 is the data structure of the explosion object;

FIG. 7 is a diagram explaining the structure of the explosion object;

FIG. 8 is an explanatory diagram of motion interpolation processing;

FIG. 9 is an explanatory diagram of enemy character action upon beingshot in conventional art;

FIG. 10 is an explanatory diagram of enemy character action upon beingshot in conventional art;

FIG. 11 is an explanatory diagram of a motion being half cancelled;

FIG. 12 is an explanatory diagram of the flight locus of a bullet seenfrom the player's line of sight;

FIG. 13 is an explanatory diagram of collision judgment in conventionalart;

FIG. 14 is an explanatory diagram of collision judgment in conventionalart;

FIG. 15 is an explanatory diagram of collision judgment in the presentinvention;

FIG. 16 is an explanatory diagram of collision judgment in the presentinvention;

FIG. 17 is an explanatory diagram of collision judgment in the presentinvention;

FIG. 18 is an explanatory diagram of collision judgment in the presentinvention;

FIG. 19 is an explanatory diagram of the structure of an objectrepresenting a wave motion;

FIG. 20 is an explanatory diagram of the structure of stages in ashooting game;

FIG. 21 is a perspective view of the body of the game device of thepresent invention;

FIG. 22 is a side view of the body of the game device of the presentinvention;

FIG. 23 is a front view and planar view of the game device of thepresent invention;

FIG. 24 is a mounting diagram of the vibration generating device; and

FIG. 25 is a circuit diagram of the vibration generating mechanism.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

The embodiments of the present invention are now explained withreference to the relevant drawings. The image processing device (gamedevice) of the present embodiment relates to a shooting game. In thisshooting game, scores are competed for by a player-operated playercharacter flying freely within a virtual three-dimensional space uponriding a flying machine, and attacking enemy characters (target object)with a machine gun mounted on the flying machine in accordance with theplayer's operations.

<Structure of the Game Device>

FIG. 1 shows the external appearance of the game device. In thisdiagram, a game device main body 1 is shown. This box-shaped game devicemain body 1 has a display la provided on the front face thereof. Speakermounting holes are provided on both sides of the display 1 a andspeakers 14 (not shown) are mounted thereon.

An operation panel 2 is provided on the front face of the lower part ofthe display 1 a, and a gun unit 11 is provided on this operation panel2. This gun unit 11 has a trigger and is operated by the player.

A game processing board is provided inside the game device main body 1.The display 1 a, gun unit 11 of the operation panel 2, and speakers areconnected to the game processing board. By this, the player is able toenjoy a gun shooting game by watching the display 1 a and using the gununit 11 of the operation panel 2.

FIG. 2 is an overall diagram of a flying machine 22 and a playercharacter 21 riding such flying machine. The flying machine 22 isequipped with a machinegun 23 which, upon the operations of the playercharacter 21, successively fires bullets and attacks the enemycharacter. Enemy characters ride flying devices such as air bikes androcket belts and fly freely in a city (within a virtualthree-dimensional space). The player character is a member of anantiterrorist squad and is ordered to exterminate the enemy charactersdestroying the city. The machinegun 23 may be an automatic machinegunwith unlimited supply of ammunition.

FIG. 3 is a block diagram of the game device pertaining to the presentembodiment. This game device, in short, comprises a display 1 a, gununit 11, game processing board 10, output device 12, and speakers 14.

The game processing board comprises a counter 100, CPU (centralprocessing unit) 101, ROM 102, RAM 103, sound device 104, I/O interface106, scroll data operation device 107, coprocessor (auxiliary operationprocessing device) 108, landform data ROM 109, geometalizer 110, shapedata ROM. 111, drawing device 112, texture data ROM 113, texture map RAM114, frame buffer 115, image synthesis device 116, and D/A converter117.

The CPU 101 is connected, via a bus line, to the ROM 102 storingprescribed programs and image processing programs, RAM 103 storing data,sound device 104, I/O interface 106, scroll data operation device 107,coprocessor 108, and geometalizer. 110. The RAM 103 functions as abuffer, and performs writing of various commands (display of object,etc.) to the geometalizer and writing of necessary data upon performingvarious operations.

The I/O interface 106 is connected to the trigger of the gun unit 11,position sensor, and pedal sensor 4. Operation signals from the triggerof the gun unit 11, position sensor, and pedal sensor 4 are read by theCPU 101 as digital data. The CPU performs image processing pursuant tothese operation signals. Upon receiving the input of trigger signalsfrom the gun unit 11, the CPU 101 provides vibration to the outputdevice 12 via the I/O interface 106. This output device is, for example,composed of a sound vibration device such as a base shaker (explained indetail below), and provides vibration near the player's feet. The playeris able to enjoy a realistic shooting game due to this vibration. Thesound device 104 is connected to the speakers 14 via a power amplifier105, and the sound signals generated at the sound device 104 areprovided to the speakers after being power amplified.

The CPU 101 performs action calculation (simulation) and special effectscalculation upon reading operation signals from the gun unit 11 pursuantto a program built in the ROM 102, landform data from the landform dataROM 109, and motion data from the shape data ROM 111 (three-dimensionaldata, for example, “characters such as enemy characters and the playercharacter” and “backgrounds such as landforms, skies, roads,skyscrapers, and various buildings”).

Action calculation is for simulating the movement of characters in avirtual space. After the coordinate values in the three-dimensionalvirtual space are determined, conversion matrix for converting thesecoordinate values to a visual field coordinate system, and polygon dataare designated by the geometalizer 110. The landform data ROM 109 isconnected to the coprocessor 108, and predetermined landform data isdelivered to the coprocessor 108 (and the CPU 101). The coprocessor 108mainly handles the operation of floating points. Consequently, thecoprocessor 108 performs various judgments and, as such judgment resultsare provided to the CPU 101, the calculation burden of the CPU isreduced.

The geometalizer 110 is connected to the shape data ROM 111 and thedrawing device 112. As mentioned above, shape data (three-dimensionaldata such as characters, landforms, and backgrounds made from each ofthe apexes) formed of a plurality of polygons is stored in the shapedata ROM 111 in advance, and this shape data is delivered to thegeometalizer 110. By performing perspective conversion to the shape datadesignated by the conversion matrix sent from the CPU 101, thegeometalizer 110 obtains data converted from the coordinate system inthe three-dimensional space to a visual field coordinate system.

The drawing device 112 affixes textures to the converted shape data ofthe visual field coordinate system and outputs the result to the framebuffer 115. Due to the affixation of these textures, the drawing device112 is connected to the texture data ROM 113 and the texture map SAM114, as well as to the frame buffer 115. Here, polygon data shall mean arelative or absolute data group of each apex of a polygon (mainly atriangle or quadrilateral) formed of an aggregate of a plurality ofapexes.

Stored in the landform data ROM 109 is polygon data set comparativelyrough, sufficient for performing prescribed judgments. On the otherhand, stored in the shape data ROM 111 is polygon data set moreprecisely in relation to the shape structuring displays such as enemiesand backgrounds.

The scroll data operation device 107 is for operating scroll screen dataof letters and the like (stored in the ROM 102). This operation device107 and the frame buffer 115 result in the display 1 a via the imagesynthesizing device 116 and the D/A converter 117. By this, polygonscreens (simulation results) such as enemies and landforms (backgrounds)temporarily stored in the frame buffer 115 and scroll screens ofnecessary letter information are synthesized according to the designatedpriority, and a final frame image data is generated. This image data isconverted into analog signals at the D/A converter 117 and sent to thedisplay 1 a, and the game image is displayed in real time.

The shooting game program in the present embodiment may be configuredsuch that it performs the game by reading such program from a prescribedrecording medium. Here, an information recording medium is any form ofphysical means having recorded thereon information (a game program forexample) in the recording area of such medium, and includes a CD-R, gamecartridge, floppy disc, magnetic tape, optical magnetic disc, CD-ROM,DVD-ROM, DVD-RAM, ROM cartridge, RAM memory cartridge w/battery backup,flash memory cartridge, nonvolatile RAM cartridge, and so on.

This also includes communication mediums of wire communication mediumssuch as telephone circuits and radio communication mediums such asmicrowave circuits. The Internet is also included in the communicationmedium mentioned above.

<Image Processing of Explosion Pictures>

The image processing steps of explosion pictures of a bullet and thelike in shooting games are now explained with reference to FIG. 4. TheCPU 101 inputs operation signals of the likes of a gun unit 11 and pedalsensor 4 via the I/O interface 106 (step A1) and displays on the screena flight condition of a bullet (step A2). In other words, the flightlocus of the bullet is calculated in relation to the position, speed,etc. of the player character and the flight condition of the bullet isdisplayed on the screen in accordance with such locus. Next, thecollision judgment is made with respect to the bullet and enemycharacters, skyscrapers, bridges, other buildings, roads, etc. arrangedwithin the virtual space (step A3). Collision judgment is the judgmentof contact between two objects. Polygons for collision judgment are setfor the respective objects, and collision judgment is conductedaccording to the crossing of these polygons. When a bullet collides withsome object, an explosion picture of the bullet is displayed on thescreen (step A4).

The image processing of explosion pictures in S404 is realized bycombining spherical polygons (or three-dimensionally structured objectsfor representing explosions) and planar polygons (or two-dimensionallystructured objects for representing explosions). This is explained withreference to FIG. 5. In FIGS. 5(A), (B), and (C) respectively representtimes T₁, T₂, and T₃ in the explosion picture. In order to realize thisexplosion picture, loci P₁ and P₂ of sparks, smoke, flames, and the likeare foremost set in consideration of the impact area of the bullet,impact angle of the bullet, speed of the bullet, and so on. Next,spherical polygons and planar polygons are arranged such that theboundaries thereof overlap in the direction of these loci P₁ and P₂ Forexample, in time T₁, spherical polygon R1, planar polygon S1, sphericalpolygon R2, and planar polygon R2 are arranged such that they overlapwith their respective boundaries. In time T₂, spherical polygon R3 isarranged such that it covers the periphery (boundary),of planar polygonS2. Similarly, in time T₃, planar polygon S3 is arranged such that itcovers the boundary of spherical polygon R3. Therefore, by covering theboundaries of the planar polygons with spherical polygons, it ispossible to overcome the unnaturalness of linear boundaries caused byexplosion pictures realized only with planar polygons.

Next, explained below is explosion processing of the enemy character hitby a bullet, that is, processing in which a segment (fragment) of theenemy character's body scatters (processing for scattering within avirtual three-dimensional space a section of the polygons structuringthe enemy character, which is a target object). Foremost, the CPU refersto the life gauge of the enemy character hit by a bullet. This lifegauge displays the remaining energy of the enemy character, and when thelife gauge becomes zero, the enemy is defeated. In other words, theenemy character is erased from the virtual three-dimensional space. Ifthe life energy is not zero, the enemy character is still alive. Thus,displayed is a picture of a segment of the enemy character's body(fragment, i.e., a section of the polygons among the group of polygonsstructuring the enemy character) scattering on the proximal end of thescreen. On the other hand, if the life energy is zero, displayed is apicture of a segment of the enemy character's body (fragment) scatteringon the distal end of the screen as the enemy character is dead.Accordingly, by changing the scattering direction of the segment(fragment) of the enemy character's body, the player can easily judgewhether the enemy character is dead or alive. When shooting enemycharacters with machineguns and the like in conventional shooting games,it is not possible to judge at what stage the enemy character isdefeated as the shooting is conducted continuously. In the presentinvention, however, the judgment of whether the enemy character is deador alive can easily be made as the scattering direction of the segment(fragment) of the enemy character's body is changed during the stages ofshooting such enemy character. Thus, it is easy to proceed the game.

Further, the scattering direction of the segment (fragment) of the enemycharacter's body is not limited to the above, and may also be set to thedirections of left (when the enemy character is dead) and right (whenthe enemy character is alive) on the screen seen from the player's lineof sight. Moreover, it may be suitably and optionally set to the upwardand downward directions, and so on.

<Data Structure of the Explosion Object>

Next, the data structure of explosion objects representing explosions ofbullets and the like is explained with reference to FIG. 6. Theexplosion object is structured of a plurality of data. For example, anexplosion object is structured of four combinations of explosion dataA1, B1, B2, C1, and C2 (patterns (1) through (4)). In such case, thedata structure of the explosion object in the present embodiment is, forexample, as shown in FIG. 6(B), structured such that all four datastructures A1-B1-C1, A1-B1-C2, A1-B2-C1, and A1-B2-C2 are arrangedhierarchically. In other words, explosion data A1 common to allexplosion objects is placed at the root, and then, B1 and B2 arearranged on the second layer and C1 and C2 are arranged on the thirdlayer. Then, according to the lapse in time, they are erased in theorder arranged.

By this arrangement, it is possible to set to explosion data A1 apointer for indicating addresses of B1 and B2, and to explosion data B1and B2 a pointer for indicating addresses of C1 and C2, respectively.According to this data structure, in comparison to conventional art(FIG. 6(A)), it is possible to lessen the memory necessary for storingdata of explosion objects.

The present invention may be employed for a data structure of an objectother than an explosion object.

<Motion Interpolation Processing>

Next, motion interpolation processing is explained with reference toFIG. 8(B). Suppose that the enemy character is damaged during the“attacking motion (motion pattern M).” Thereupon, the enemy charactermakes a transition to a step which successively performs the “collapsingmotion (hit pattern H1, H2, . . . ).” In other words, in accordance withthe results of the collision judgment, the CPU reads the series ofmotion condition data conducted by the target object and displays thison a screen. At such time, motion interpolation processing C1 isperformed for a few frames between the motion pattern M and hit patternH1. Next, motion interpolation processing C2 is performed for n framesbetween hit pattern H1 and hit pattern H2. Further, motion interpolationprocessing C3 is performed n-1 frames between hit pattern H2 and hitpattern H3, and motion interpolation processing C4 is performed n-2frames between hit pattern H3 and hit pattern H4. Accordingly, bygradually decreasing the number of frames of interpolation (numberrequired to produce interpolation data), slow motion is returned to thenormal speed. That is, the speed of slow playback is gradually returnedto the normal speed. By this, it is possible to lessen unnatural changesof motion patterns, thereby presenting a realistic shooting game.

If one frame is 1/60 sec, it is preferable that the value of n above iswithin the range of 1 to 4.

<Movement of Enemy Character Upon Being Damaged>

Next, the movement of the enemy character upon being damaged isexplained with reference to FIG. 10. This invention relates to themovement and action of the enemy character upon being hit by a bullet.In the present invention, the torque (distance between the centroid ofthe enemy character and the impact position of the bullet multiplied bythe force from the bullet) received by the enemy character upon beinghit by a bullet is calculated, and angle θ, the inclination of the enemycharacter, is computed pursuant to such torque. Then, position E2, aftermovement, is calculated from position E1 of the enemy character uponbeing hit by a bullet. The movement of the enemy character upon beinghit by a bullet seen from the player's line of sight is as shown in FIG.10(B). Therefore, the position change of an enemy character (model) uponbeing hit by a bullet, when seen from a player's line of sight, resultsin a two-dimensional position shift (position change of a character isin a direction other than the direction of line of sight from thevirtual viewpoint). Thus, taking aim with a machinegun becomesdifficult, thereby necessitating the improvement of one's skill. Inother words, heretofore, as enemy characters being hit by a bullet onlyshowed two-dimensional position changes when seen from the player's lineof sight, continuous hits with bullets were possible. On the other hand,the present embodiment prevents such easy continuous hits.

<Half-cancel of Motions>

Next, the half-cancel of motions is explained. Half-cancel of motionsis, upon making a transition to another motion pattern (2) during theperformance of a motion pattern (1) made from a plurality of motionsteps, storing the motion step M at such time and performing motionpattern (1) from such motion step M after the completion of motionpattern (2). This point is explained with reference to FIG. 11(B). Here,the enemy character starts the attacking motion and successivelyperforms each of the attacking steps M₁, M₂, . . . , M_(n-1), M_(n).Suppose that the enemy character is hit by bullets from a playercharacter and damaged in attacking step M₃. Then, the CPU stores theidentification information of attacking step M₃ in the RAM and makes atransition to the shot-down motion. After the completion of theshot-down motion, the CPU returns once again to the attacking motionfrom attacking step M₃ pursuant to the identification information storedin the aforementioned RAM. According to this structure, as the enemycharacter immediately makes a transition to an attacking mode uponcompletion of the shot-down motion, no opportunity is provided to theplayer for attacking as in the conventional art. Therefore, thedifficulty of the game is prevented from being heedlessly lowered, andthe amusement of the game is increased.

Further, when returning to attacking step M₃ in the aforementionedexample, the setting can be such that the return is made a few framesbefore or after the shot-down motion.

Moreover, a weak point of an enemy character can be set. In such case, ahalf-cancel of motions is performed upon returning from the shot-downmotion if the bullet hits this weak point, or, if the bullet hits anyother point other than this weak point, the attacking is continuedwithout a transition to the shot-down motion. When set like the above,the amusement of the game increases because in order for the player toprogress the game advantageously, such player is required to aim at theweak point of the enemy character.

<Method of Controlling Flight Locus of Bullet>

Next, the method of controlling the flight locus of a bullet isexplained with reference to FIG. 12. The method of the present inventionfor controlling the light locus of a bullet, for example, controls theflight locus of a bullet seen from the player's viewpoint pursuant tothe distance between the bullet and the player character. If FIG. 12(B),suppose that the bullet is flying at speed V₁ and the player characteris moving at speed V₂. The CPU obtains the distance between the bulletand the player character from the coordinates thereof. Then, in order toobtain the flight locus of the bullet seen from the player's viewpoint,a synthetic vector V₃=V₁−kV₁ is obtained by multiplying to speed V₂ thecoefficient k which is inversely proportioned to the aforementioneddistance. This synthetic vector V₃ is the speed vector of the bulletseen from the player's viewpoint.

According to this structure, the speed V₂ of the player character hardlyinfluences the flight locus of the bullet when the distance between thebullet and player character is far. On the other hand, if such distancebetween the two is near, the speed of the bullet is adjusted inaccordance with the speed V₂ of the player character. Thus, problems aswith the conventional art do not arise.

<Acceleration of Collision Judgment>

Next, the acceleration of collision judgment is explained. In order torealize the acceleration of collision judgment, the present inventiondivides the game screen, that is, the overall virtual space, into grids.Then, the unit grid in which an object subject to collision judgmentexists is searched, and collision judgment with respect to all objectsexisting in such unit grid is performed. This is explained withreference to FIG. 15. FIG. 15(A) is a picture of a city, in a simplifiedand modeled form, realized on the virtual space 70. Objects, such asbuildings 201, 202 and 203 are shown therein. FIG. 15(B) sets aprescribed three-dimensional area 50 within the virtual space anddivides this three-dimensional area 50 into unit grids 51, 52, 53, andso on. For example, suppose the respective lengths of directions x, yand z of these unit grids is 1. FIG. 16(A) is a diagram projected onplane xy, and FIG. 16(B) is a diagram projected on plane xz.

Collision judgment, for example, is performed on the likes of bullet andbuilding, moving character and wall, in other words, a moving object andan object with a fixed position on the virtual space (or, polygonsforming the object or polygons to be used for the collision judgment ofsuch object). In this case, the moving object is represented in vectors(line segment holding size and direction) and collision judgment isperformed with another object (object with a fixed position on thevirtual space and an object other than the aforementioned movingobject). Steps of collision judgment are explained with reference toFIG. 17. As shown in FIG. 17(A), objects such as buildings existing ineach of the unit grids are made into a list. Collision judgment isperformed in accordance with the steps shown in FIG. 17(B). First, anobject for collision judgment, for example, the unit grid in which thebullet is existing, is searched (step C1). This step models the bulletas a vector and checks in which unit grid the coordinates of thestarting and terminating points of the vector exist. Next, if a unitgrid with a bullet exists, it then performs collision judgment with thepolygons forming the object existing in such unit grid (step C2). Forexample, as shown in FIG. 16(A), the bullet moving within the virtualspace is represented by a vector 40, and if this vector 40 exists in theunit grid 54, collision judgment with the polygons forming the object201 existing in this unit grid 54 is performed. As this will allow thedecrease in polygon numbers in which collision judgment is to beperformed, acceleration of processing is possible.

Further, it is also possible to perform collision judgment by setting athree-dimensional area around the periphery of an optional objectarranged within the virtual space and dividing this three-dimensionalarea into unit grids. For example, as shown in FIG. 18, athree-dimensional area 60 is set around the periphery of the automobile204 moving on the virtual space 70, and this three-dimensional area 60is divided into unit grids 61, 62, and so on. According to thisstructure, it is possible to decrease the number of polygons in whichcollision judgment is to be performed. Moreover, it is possible toperform collision judgment more precisely and more accurately.

Thus, according to the present embodiment, since it is not necessary toperform collision judgment with every object existing within the virtualspace and all polygons forming the object, the amount of calculation isdecreased, and the processing speed is greatly accelerated. In addition,since the position of the vector can be easily determined by comparisonof coordinates, collision judgment need only be performed with thevectors positioned within the three-dimensional space, and thecalculation amount is reduced. Further, the number of unit grids can besuitably set to an adequate number such that the calculation amount isreduced in consideration of the size, quantity, position, density, etc.of the object arranged within the virtual space.

<Representation of Waves>

Next, the method of representing waves according to the presentembodiment is explained with reference to FIG. 18. In the presentembodiment, polygons representing the waves are, as shown in FIG. 18(A),formed of a gathering of numerous rectangular polygons P₁, P₂, P₃, andso on in which the lengthwise direction thereof is the direction of thewave's depth. And, by changing the respective heights h₁, h₂, h₃, . . ., of rectangular polygons P₁, P₂, P₃, . . . , in accordance withpredetermined steps, the movement of waves may be represented. FIGS.18(A), (B), and (C) respectively correspond to time T₁, T₂, and T₃.Heights of rectangular polygons P₁, P₂, P₃, . . . , for example, arechanged as a simple harmonic motion movement such that wave frequenciesare represented as simple harmonic motions.

<Configuration of Game Stages>

Next, the configuration of game stages is explained with reference toFIG. 19. Game stages pertaining to the present embodiment are configuredsuch that the first stage and final stage are fixed, and the player maysuitably select intermediate stages. In other words, upon the start of agame, the game device automatically performs stage 1 with apredetermined program (step D1). After the completion of stage 1, thescore in stage 1 is displayed on the screen. Then, a screen forselecting the next stage is displayed and the player selects the nextstage (step D2). For example, if stage 3 is selected, stage 3 isperformed (step D3). Thereafter, a transition to step S192 is made onceagain (step D4: NO), and the next stage is selected. Like this, afterall stages have been completed (step D4: YES), the final stage isperformed (step D5). After the completion of the final stage, the totalscore and so on are displayed, and it brings the game to an end.

By the intermediate stages being selected by the player and performed,the flow of the game will be in accordance with the player's intention.Further, by restricting the order of selecting the game stages or thestages selectable by a player in relation to scores of previous stagesand the like, the amusement of the game is enhanced.

<Evaluation Standards of Scores>

There are four evaluation standards for the scores in the shooting gamepertaining to the present invention.

(1) Evaluation Per Enemy Plane

This evaluation of the score is conducted in accordance with the methodof shooting down the respective enemy characters, the time required forsuch shoot down, the number of bullets fired, and so forth.

(2) Evaluation Per Enemy Troop

An enemy character is not limited to being independent, but may alsoattack in troops. Thus, shorter the time required for eliminating theenemy troop, higher the evaluation. This evaluation, for example, iscomposed of six stages, and the bonus percentage is determined by theranking in each of these stages.

(3) Evaluation Per Stage

Rankings per stage is conducted pursuant to the player's score in eachstage.

(4) Evaluation Per Game

Rankings per game is conducted pursuant to the total score of one game.

Accordingly, by dividing the evaluation standards of scores to enemies,enemy troops, etc., score evaluation in a variety of forms is possibleby the combination thereof.

<Vibration Generating Mechanism>

The vibration generating mechanism in the game device of the presentembodiment is explained with reference to FIGS. 21 to 25. FIG. 21 is aperspective view of a body 600 of the game device and a display 701. Thebody 600 has a base 603 and a prop 604, and various operation buttonsand guns 601 are attached on this prop 604. The player shoots the enemycharacters displayed on the display 701 by operating this gun 601. FIG.22 is a side view, FIG. 23(A) is the front view and FIG. 23(B) is aplane view of this body. A vibration plate 602 is provided at theposition where the player places his/her feet on the base 603. As shownin FIG. 24, vibration generating devices (“Base Shakers”) 605R and 605Lare provided on the reverse side of this vibration plate (position ofthe player's feet). When the bullet hits the enemy character, these BaseShakers 605R and 605L generate vibrations simultaneously with theexplosion picture of such enemy character being displayed on the display701. As Base Shakers 605R and 605L, low-frequency sound vibrationgenerating devices may be used. Preferably used is, for example, the“130-5172” transducer manufactured by Aura company (sold by Kaga DenshiCompany).

The circuitry of the vibration generating mechanism of the presentembodiment is explained with reference to FIG. 25. The sound processingunit 801 comprises a sound CPU, sound memory, and D/A converter. In thesound memory, other than sound data (waveform data) such as backgroundmusic set for each game scene, registered is vibration waveform datawhich is previously associated to each object. Sound effects such asbackground music predetermined for each game scene are generated by thesound CPU reading sound data (waveform data) from the sound CPU inaccordance with the aforementioned game program, D/A converting thisdata and outputting to the amplifier 802 two-channel signals, andoutputting the result to speakers 702R and 702L. Further, low-pitch basssounds are realized by synthesizing the aforementioned two channels inthe amplifier 802, making this synthesized signal pass through theamplifier 803 having a low-pass filter, and outputting this to a woofer702C.

Contrarily, upon generating vibrations in sync with the explosionpicture of enemy characters and the like, the following method is taken.When a bullet hits the enemy character and a command for generatingvibrations in sync with the explosion of the enemy character isdelivered from the main CPU (not shown) to the sound CPU, the sound CPUreads from the sound memory vibration waveform data which is previouslyassociated with each object, D/A converts this into two-channel signalsand outputs the same to the amplifier 804. Signals amplified at theamplifier 804 are input to the Base Shakers 605R and 605L to vibrate thevibration plate 602.

According to the vibration generating mechanism of the presentembodiment, sound data for background music and vibration waveform datapertaining to the explosion of objects are divided and registered in thesound memory such that the respective signal paths are different. Thus,it is no longer necessary to vibrate the Base Shaker with sound signalsgenerated pursuant to sound data for background music, and suitablevibrations are generated in accordance with the scene. Moreover, theunnaturalness of the Base Shaker unnecessarily vibrating in accordancewith the sound of background music may also be resolved.

1. An image processing device for representing a series of motions of anobject, comprising: storage means for storing in advance one or moremotion patterns of said object, wherein each motion pattern includes aplurality of frames of image data which, when taken together, form amotion; and image generating means for generating images of said objectby alternately repeating, upon a change from a first motion pattern ofthe one or more motion patterns to a second motion pattern of the one ormore motion patterns of said object, a step of performing motioninterpolation processing of the object and displaying the result on ascreen, and gradually decreasing the number of times said motioninterpolation processing is performed, and after the change, a step ofreading the first motion pattern from said storage means and displayingthe result on the screen.
 2. An image processing device according toclaim 1, wherein the first motion pattern of said object is an“attacking motion” and the second motion pattern of said object is a“collapsing motion upon being shot.”
 3. An image processing device fordisplaying a series of motions of an object, comprising: first storagemeans for storing each of one or more previously divided motion patternsof said object as a plurality of motion steps, wherein each motion stepcorresponds to a frame of image data; image generating means for readinga first motion pattern of the one or more previously divided motionpatterns from the first storage means and displaying the same on ascreen; detecting means for detecting a motion change in the firstmotion pattern of said object; first image controlling means for storingidentification information of a motion step associated with the firstmotion pattern in a second storing means when said detecting meansdetects the motion change, and controlling said image generating meanssuch that it reads a second motion pattern of the one or more previouslydivided motion patterns from said first storage means and displays thesame on the screen; and second image controlling means for making saidimage generating means perform, upon completion of displaying images ofthe second motion pattern, a transition motion step motion pattern ofsaid object pursuant to said identification information stored in saidsecond storage means.
 4. An image processing device according to claim3, wherein said object is an “enemy character,” the first motion patternof the one or more previously divided motion patterns is an “attackingmotion,” and the second motion pattern of the one or more motionpatterns is a “collapsing motion upon being shot.”